Radio frequency identification (rfid) tag location verification using image data

ABSTRACT

Electronic Article Surveillance in which a radio frequency identification (RFID) interrogation signal is transmitted, over a first window of time, into an RFID interrogation zone of the EAS system. A plurality of response signals are detected from a first RFID tag of the EAS system responding to the interrogation signal. Over a second window of time overlapping at least in part with the first window of time, image data is captured within a field of view. The field of view and the RFID interrogation zone overlap to form a zone of interest. Movement of a non-tag object is characterized during the first window of time based on the image data. Whether the first RFID tag is associated with the characterized non-tag object is determined based on a comparison of the detected plurality of response signals and the characterized movement of the non-tag object.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Application No.62/894,680, entitled “VIDEO VALIDATION OF ELECTRONIC ARTICLESURVEILLANCE ALARM EVENTS FROM RFID TAGS,” filed Aug. 30, 2019, which isexpressly incorporated by reference herein in its entirety.

BACKGROUND Technical Field

The present disclosure relates generally to Electronic ArticleSurveillance (EAS). Examples related to EAS using a Radio FrequencyIdentification (RFID) tag with tag location verified by image data.

Introduction

EAS systems are commonly used in retail stores and other settings toprevent the unauthorized removal of goods from a protected area.Typically, a detection system is configured at an exit from theprotected area, which comprises one or more transmitters and antennas(“pedestals”) capable of generating an electromagnetic field across theexit, known as the “interrogation zone.” Articles to be protected aretagged with an EAS marker that, when active, generates a response signalwhen passed through this interrogation zone. An antenna and receiver inthe same or another “pedestal” detects this response signal andgenerates an alarm.

SUMMARY

The following presents a simplified summary of one or more aspects inorder to provide a basic understanding of such aspects. This summary isnot an extensive overview of all contemplated aspects and is intended toneither identify key or critical elements of all aspects nor delineatethe scope of any or all aspects. Its sole purpose is to present someconcepts of one or more aspects in a simplified form as a prelude to themore detailed description that is presented later.

An example implementation includes a method of electronic articlesurveillance (EAS), including transmitting, over a first window of time,a radio frequency identification (RFID) interrogation signal into anRFID interrogation zone of the EAS system. The system detects aplurality of response signals from a first RFID tag of the EAS systemresponding to the interrogation signal. The EAS system captures, over asecond window of time overlapping at least in part with the first windowof time, image data within a field of view. The field of view and theRFID interrogation zone overlap to form a zone of interest. The EASsystem characterizes movement of a non-tag object during the firstwindow of time based on the image data. The EAS system then determineswhether the first RFID tag is associated with the characterized non-tagobject based on a comparison of the detected plurality of responsesignals and the characterized movement of the non-tag object.

In some examples, the capturing is in response to the detecting. In somesuch examples, detecting includes detecting that the tag is notauthorized to be in the RFID interrogation zone. In some such examples,the EAS system alarms in response to determining that the first RFID tagis associated with the characterized non-tag object based on acomparison of the detected plurality of response signals and thecharacterized movement of the non-tag object.

In some examples, characterizing includes estimating one or more of aspeed of the non-tag object and the direction of travel of the non-tagobject. In some examples, determining whether the first RFID tag isassociated with the characterized non-tag object includes determining asimilarity greater then a threshold similarity between the detectedplurality of response signals and the characterized movement of thenon-tag object.

To the accomplishment of the foregoing and related ends, the one or moreaspects comprise the features hereinafter fully described andparticularly pointed out in the claims. The following description andthe annexed drawings set forth in detail certain illustrative featuresof the one or more aspects. These features are indicative, however, ofbut a few of the various ways in which the principles of various aspectsmay be employed, and this description is intended to include all suchaspects and their equivalents

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustration of an illustrative architecture for a system.

FIG. 2 is an illustration of an illustrative architecture for a tag.

FIG. 3 is an illustration of an illustrative architecture for a tagreader.

FIG. 4 is an illustration of an illustrative architecture for a server.

FIG. 5 is a flow chart of a method of electronic article surveillance,in accordance with examples of the technology disclosed herein.

FIG. 6 is an illustration of an architecture, in accordance withexamples of the technology disclosed herein.

FIG. 7 is a flow chart of a method of electronic article surveillance,in accordance with examples of the technology disclosed herein.

FIG. 8 is an illustration of a computing device including components forperforming the function of examples of the technology disclosed herein.

DETAILED DESCRIPTION

It will be readily understood that the components of the embodiments asgenerally described herein and illustrated in the appended figures couldbe arranged and designed in a wide variety of different configurations.Thus, the following more detailed description of various embodiments, asrepresented in the figures, is not intended to limit the scope of thepresent disclosure, but is merely representative of various embodiments.While the various aspects of the embodiments are presented in drawings,the drawings are not necessarily drawn to scale unless specificallyindicated.

The present solution may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the present solution is, therefore,indicated by the appended claims rather than by this detaileddescription. All changes that come within the meaning and range ofequivalency of the claims are to be embraced within their scope.

Reference throughout this specification to features, advantages, orsimilar language does not imply that all of the features and advantagesthat may be realized with the present solution should be or are in anysingle embodiment of the present solution. Rather, language referring tothe features and advantages is understood to mean that a specificfeature, advantage, or characteristic described in connection with anembodiment is included in at least one embodiment of the presentsolution. Thus, discussions of the features and advantages, and similarlanguage, throughout the specification may, but do not necessarily,refer to the same embodiment.

Furthermore, the described features, advantages, and characteristics ofthe present solution may be combined in any suitable manner in one ormore embodiments. One skilled in the relevant art will recognize, inlight of the description herein, that the present solution can bepracticed without one or more of the specific features or advantages ofa particular embodiment. In other instances, additional features andadvantages may be recognized in certain embodiments that may not bepresent in all embodiments of the present solution.

Reference throughout this specification to “one embodiment,” “anembodiment,” or similar language means that a particular feature,structure, or characteristic described in connection with the indicatedembodiment is included in at least one embodiment of the presentsolution. Thus, the phrases “in one embodiment”, “in an embodiment,” andsimilar language throughout this specification may, but do notnecessarily, all refer to the same embodiment.

As used in this document, the singular form “a,” “an,” and “the” includeplural references unless the context clearly dictates otherwise. Unlessdefined otherwise, all technical and scientific terms used herein havethe same meanings as commonly understood by one of ordinary skill in theart. As used in this document, the term “comprising” means “including,but not limited to.”

In the retail industry, it is common to “source tag” merchandise withRFID tags, either at the time of packaging/manufacture, or at some otherpoint in the in the supply chain. At the same time, electronic articlesurveillance (EAS) technology and devices have proven critical to thereduction of theft and so called “shrinkage.” Since many items arrive atthe retailer with RFID tags, it is desirable that RFID tag be used alsoto provide EAS functionality in addition to their intended function ofproviding capabilities such as inventory control, shelf reading,non-line of sight reading, etc.

It is known to achieve combined EAS and RFID functions by physicallypackaging separate RFID and EAS tags together in a single housing. Inthis arrangement, the RFID and EAS functions are usually implemented asseparate, discrete components that are co-located within one enclosure.In this arrangement, there are drawbacks relating to cost, size andperformance degradation and interference caused by placing the full EASand RFID components in close proximity.

In some implementations, an RFID tag can be used to simulate EASfunctionality by sending special codes when a reader interrogates theRFID tag. This arrangement advantageously eliminates the need for aseparate EAS component within the tag, or a separate EAS tag.

Currently, using RFID as an EAS exit solution is limited by stray orreflected alarms when transmission powers are increased. People walkingthrough the EAS portal may trigger alarms even if they aren't removingmerchandise from the premises without authorization. Alarms can becaused by stationary RFID tags located some distance from the exit.Further, such an approach limits the ability for the retailer to placemerchandise too close to the exit system due to false alarms. The largeread ranges of the RFID technology coupled with RF reflections makes itvery difficult to control the RFID system's detection area at the exit.

Examples of the technology disclosed herein can logically AND the RFIDsignal response with event data indicators derived from a video systemdata captured by cameras installed near the EAS portal. Thisadvantageously reduces false alarms, and at the same time can allow forreduced transmission power.

These and other features of the present disclosure are discussed indetail below with regard to FIG. 1-XXX.

Referring now to FIG. 1, there is provided a schematic illustration ofan illustrative system 100 that is useful for understanding the presentsolution. The present solution is described herein in relation to aretail store environment. The present solution is not limited in thisregard, and can be used in other environments. For example, the presentsolution can be used in distribution centers, factories and othercommercial environments. Notably, the present solution can be employedin any environment in which objects and/or items need to be locatedand/or tracked.

The system 100 is generally configured to allow (a) improved inventorycounts and surveillance of objects and/or items located within afacility, and (b) improved customer experiences. As shown in FIG. 1,system 100 comprises a Retail Store Facility (“RSF”) 128 in whichdisplay equipment 102 ₁, . . . , 102 _(M) is disposed. The displayequipment is provided for displaying objects (or items) 110 ₁-110 _(N),116 ₁-116 _(X) to customers of the retail store. The display equipmentcan include, but is not limited to, shelves, article display cabinets,promotional displays, fixtures, and/or equipment se-curing areas of theRSF 128. The RSF can also include emergency equipment (not shown),checkout counters, and an EAS system (not shown). Emergency equipment,checkout counters, video cameras, people counters, and EAS systems arewell known in the art, and therefore will not be described herein.

At least one tag reader 120 is provided to assist in counting andtracking locations the objects 110 ₁-110 _(N), 116 ₁-116 _(X) within theRSF 128. The tag reader 120 comprises an RFID reader configured to readRFID tags. RFID readers are well known in the art, and therefore will bedescribed at a sufficient level of detail below for understanding of theclaimed invention. Any known or to be known RFID reader can be usedherein without limitation as a basis for the technology disclosedherein.

RFID tags 112 ₁-112 _(N), 118 ₁-118 _(X) are respectively attached orcoupled to the objects 110 ₁-110 _(N), 116 ₁-116 _(X). This coupling isachieved via an adhesive (e.g., glue, tape, or sticker), a mechanicalcoupler (e.g., straps, clamps, snaps, etc.), a weld, chemical bond, orother means. The RFID tags can alternatively or additionally comprisedual-technology tags that have both EAS and RFID capabilities.

Notably, the tag reader 120 is strategically placed at a known locationwithin the RSF 128, for example, at an exit/entrance. By correlating thetag reader's RFID tag reads and the tag reader's known location withinthe RSF 128, it is possible to determine the location of objects 110 ₁,. . . , 110 _(N), 116 ₁, . . . , 116 _(X) within the RSF 128. The tagreader's known coverage area also facilitates object locationdeterminations. Accordingly, RFID tag read information and tag readerlocation information is stored in a datastore 126. This information canbe stored in the datastore 126 using a server 124 and network 144 (e.g.,an Intranet and/or Internet).

System 100 also comprises a Mobile Communication Device (“MCD”) 130. MCD130 includes, but is not limited to, a cell phone, a smart phone, atable computer, a personal digital assistant, and/or a wearable device(e.g., a smart watch). Each of the listed devices is well known in theart, and therefore will not be described herein. In accordance with someexamples, the MCD 130 has a software application installed thereon thatis operative to: facilitate the provision of various information 134-142to the individual 152; facilitate a purchase transaction; and/orfacilitate the detachment of the RFID tags 112 ₁-112 _(N), 118 ₁-118_(X) from the objects 110 ₁, . . . , 110 _(N), 116 ₁, . . . , 116 _(X);and/or facilitate the detachment of an anchored chain or cable from theobjects 110 ₁, . . . , 110 _(N), 116 ₁, . . . , 116 _(X).

The MCD 130 is generally configured to provide a visual and/or auditoryoutput of item level information 134, accessory information 136, relatedproduct information 138, discount information 140 and/or customerrelated information 142. The item level information includes, but is notlimited to, an item description, item nutritional information, apromotional message, an item regular price, an item sale price, acurrency symbol, and/or a source of the item.

An accessory includes, but is not limited to, a useful auxiliary itemthat can be attached to or removed from an item (e.g., a drill bit orbattery of a drill). The accessory information includes, but is notlimited to, an accessory description, accessory nutritional information,a promotional message, an accessory regular price, an accessory saleprice, a currency symbol, a source of the accessory, and/or an accessorylocation in the facility.

A related product includes, but is not limited to, a product that can beused in conjunction with or as an alternative to another product (e.g.,diaper rash cream which can be used when changing a diaper, or a firstdiaper can be used as an alternative to another diaper). The relatedproduct information includes, but is not limited to, a related productdescription, related product nutritional information, a promotionalmessage, a related product regular price, a related product sale price,a currency symbol, a source of the related product, and/or a relatedproduct location in the facility.

The discount information can include, but is not limited to, a discountprice for a product based on a loyalty level or other criteria. Thecustomer related information includes, but is not limited to, customeraccount numbers, customer identifiers, usernames, passwords, paymentinformation, loyalty levels, historical purchase information, and/oractivity trends.

The item level information, accessory information, related productinformation and/or discount information can be output in a formatselected from a plurality of formats based on a geographic location ofthe item, a location of the MCD, a date, and/or an item pricing status(i.e., whether the item is on sale). In a display context, the format isdefined by a font parameter, a color parameter, a brightness parameter,and/or a display blinking parameter. In an auditory context, the formatis defined by a volume parameter, a voice tone parameter, and/or amale/female voice selected parameter.

The MCD 130 can also be configured to read barcodes and/or RFID tags.Information obtained from the barcode and/or RFID tag reads may becommunicated from the MCD 130 to the server 124 via network 144.Similarly, the stored information 134-142 is provided from the server124 to the MCD 130 via network 144. The network 144 includes an Intranetand/or the Internet.

Server 124 can be local to the facility 128 as shown in FIG. 1 or remotefrom the facility 128. Server 124 will be described in more detail belowin relation to FIG. 4. Still, it should be understood that server 124 isconfigured to: write data to and read data from datastore 126, RFID tags112 ₁-112 _(N), 118 ₁-118 _(X), and/or MCD 130; perform language andcurrency conversion operations using item level information and/oraccessory information obtained from the datastore, RFID tags, and/orMCD; perform data analytics based on inventory information, tag readinformation, MCD tacking information, and/or information 134-142;perform image processing using images captured by camera(s) 148; and/ordetermine locations of RFID tags and/or MCDs in the RSF 128 usingbeacon(s) 146, tag reader 120 or other devices having known locationsand/or antenna patterns.

In some examples, camera(s) 148 are placed to cover a zone of interestalso covered by a tag reader 120 placed to cover an RFID interrogationzone, e.g., at a portal of the retail facility 128. In some suchexamples, video images of persons approaching the exit are collected bythe camera(s) 148. A processor, e.g., in tag reader 120 or server 124,associated with the EAS portal has a software application runningthereon which analyzes the video image data to determine if a person ismoving through the portal.

The system 100 can detect and derive any number of relevant indicatorsfrom the captured video, such as whether the detected image includes aperson, the number of persons in the image, the speed a person is movingthrough the portal, other objects associated with the one or morepersons, such as shopping carts, carried items, etc., and the nature ofthe objects. In some examples, the system detects a person's walkingspeed. The captured video data is analyzed and compared to datacollected by the RFID signal response that occurred concurrently withthe person's passage through the portal. The velocity at which an RFIDtag is passing through the portal can be calculated by analyzing thecharacteristics of the response signal, such as the rate of change ofthe signal strength.

In some examples, an RFID tag response indicates that an article may bepassing thought the portal without being purchased, an alarm flag can beset. In response to the alarm flag, the rate of speed at which the tagis moving through the portal can be estimated by analyzing the RFID tagresponse over time, e.g., using on or more of the tag reader 120 and theserver 124 . . . . Also in response to the alarm flag, video data iscaptured and analyzed to identify an image data of a person who may betransporting the tag, and also to determine various factors, such as theperson's walk rate. In some examples, the person's walk rate is comparedwith the estimated rate of speed of the RFID tag. If predeterminedthresholds for similarity between the person's walk rate and theestimated rate of speed of the RFID tag are met, the system 100 cansound an alarm.

The server 124 facilitates updates to the information 134-142 outputfrom the MCD 130. Such information updating can be performedperiodically, in response to instructions received from an associate(e.g., a retail store employee 132), in response to a detected change inthe item level, accessory and/or related product information, inresponse to a detection that an individual is in proximity to an RFIDtag, and/or in response to any motion or movement of the RFID tag. Forexample, if a certain product is placed on sale, then the sale price forthat product is transmitted to MCD 130 via network 144 and/or RFID tag.The sale price is then output from the MCD 130. The present solution isnot limited to the particulars of this example.

Although a single MCD 130 and/or a single server 124 is(are) shown inFIG. 1, the present solution is not limited in this regard. It iscontemplated that more than one computing device can be implemented. Inaddition, the present solution is not limited to the illustrative systemarchitecture described in relation to FIG. 1.

During operation of system 100, the content displayed on the displayscreen of the MCD 130 is dynamically controlled based upon various tagor item related information and/or customer related information (e.g.,mobile device identifier, mobile device location in RSF 128, and/orcustomer loyalty level). Tag or item level information includes, but isnot limited to, first information indicating that an RFID tag is inmotion or that an object is being handled by an individual 152, secondinformation indicating a current location of the RFID tag and/or the MCD130, third information indicating an accessory or related product of theobject to which the moving RFID tag is coupled, and/or fourthinformation indicating the relative locations of the accessory and themoving RFID tag and/or the relative locations of the related product andthe moving RFID tag. The first, second and fourth information can bederived based on sensor data generated by sensors local to the RFID tag.Accordingly, the RFID tags 112 ₁-112 _(N), 118 ₁-118 _(X) include one ormore sensors to detect their current locations, detect any individual inproximity thereto, and/or detect any motion or movement thereof. Thesensors include, but are not limited to, an Inertial Measurement Unit(“IMU”), a vibration sensor, a light sensor, an accelerometer, agyroscope, a proximity sensor, a microphone, and/or a beaconcommunication device. The third information can be stored local to theRFID tag(s) or in a remote datastore 126 as information 136, 138.

In some scenarios, the MCD 130 facilitates the server's 124 (a)detection of when the individual 152 enters the RSF 128, (b) tracking ofthe individual's movement through the RSF, (c) detection of when theindividual is in proximity to an object to which an RFID tag is coupled,(d) determination that an RFID tag is being handled or moved by theindividual based on a time stamped pattern of MCD movement and atimestamped pattern of RFID tag movement, and/or (e) determination of anassociation of moving RFID tags and the individual.

When a detection is made that an RFID tag is being moved, the server 124can, in some scenarios, obtain customer related information (such as aloyalty level) 142 associated with the individual 152. This informationcan be obtained from the individual's MCD 130 and/or the datastore 126.The customer related information 142 is then used to retrieve discountinformation 140 for the object to which the RFID tag is coupled. Theretrieved discount information is then communicated from the server 124to the individual's MCD 130. The individual's MCD 130 can output thediscount information in a visual format and/or an auditory format. Otherinformation may also be communicated from the server 124 to theindividual's MCD 130. The other information includes, but is not limitedto, item level information, accessory information, and/or relatedproduct information.

In those or other scenarios, a sensor embedded in the RFID tag detectswhen an individual is handling the object to which the RFID tag iscoupled. When such a detection is made, the RFID tag retrieves theobject's unique identifier from its local memory, and wirelesslycommunicates the same to the tag reader 120. The tag reader 120 thenpasses the information to the server 124. The server 124 uses theobject's unique identifier and the item/accessory relationshipinformation (e.g., table) 136 to determine if there are any accessoriesassociated therewith. If no accessories exist for the object, the server124 uses the item level information 134 to determine one or morecharacteristics of the object. For example, the object includes aproduct of a specific brand. The server 124 then uses the item/relatedproduct information (e.g., table) 138 to identify: other products of thesame type with the same characteristics; and/or other products that aretypically used in conjunction with the object. Related productinformation for the identified related products is then retrieved andprovided to the MCD 130. The MCD 130 can output the related productinformation in a visual format and/or an auditory format. The individual152 can perform user-software interactions with the MCD 130 to obtainfurther information obtain the related product of interest. The presentsolution is not limited to the particulars of this scenario.

Referring now to FIG. 2, there is an illustration of an illustrativearchitecture for a tag 200. RFID tags 112 ₁, . . . , 112 _(N), 118 ₁, .. . , 118 _(X) are the same as or similar to tag 200. As such, thediscussion of tag 200 is sufficient for understanding the RFID tags 112₁, . . . , 112 _(N), 118 ₁, . . . , 118 _(X) of FIG. 1. Tag 200 isgenerally configured to perform operations to (a) minimize power usageso as to extend a power source's life (e.g., a battery or a capacitor),(b) minimize collisions with other tags so that the tag of interest canbe seen at given times, (c) optimize useful information within aninventory system (e.g., communicate useful change information to a tagreader), and/or (d) optimize local feature functions.

The tag 200 can include more or less components than that shown in FIG.2. However, the components shown are sufficient to disclose anillustrative embodiment implementing the present solution. Some or allof the components of the tag 200 can be implemented in hardware,software and/or a combination of hardware and software. The hardwareincludes, but is not limited to, one or more electronic circuits. Theelectronic circuit(s) may comprise passive components (e.g., capacitorsand resistors) and active components (e.g., processors) arranged and/orprogrammed to implement the methods disclosed herein.

The hardware architecture of FIG. 2 represents a representative tag 200configured to facilitate improved inventory management/surveillance andcustomer experience. In this regard, the tag 200 is configured forallowing data to be exchanged with an external device (e.g., tag reader120 of FIG. 1, a beacon 146 of FIG. 1, a Mobile Communication Device(“MCD”) 130 of FIG. 1, and/or server 124 of FIG. 1) via wirelesscommunication technology. The wireless communication technology caninclude, but is not limited to, a Radio Frequency Identification(“RFID”) technology, a Near Field Communication (“NFC”) technology,and/or a Short Range Communication (“SRC”) technology. For example, oneor more of the following wireless communication technologies (is)areemployed: Radio Frequency (“RF”) communication technology; Bluetoothtechnology; WiFi technology; beacon technology; and/or LiFi technology.Each of the listed wireless communication technologies is well known inthe art, and therefore will not be described in detail herein. Any knownor to be known wireless communication technology or other wirelesscommunication technology can be used herein without limitation.

The components 206-214 shown in FIG. 2 may be collectively referred toherein as a communication enabled device 204, and include a memory 208and a clock/timer 214. Memory 208 may be a volatile memory and/or anon-volatile memory. For example, the memory 208 can include, but is notlimited to, Random Access Memory (“RAM”), Dynamic RAM (“DRAM”), StaticRAM (“SRAM”), Read Only Memory (“ROM”), and flash memory. The memory 208may also comprise unsecure memory and/or secure memory.

In some scenarios, the communication enabled device 204 comprises aSoftware Defined Radio (“SDR”). SDRs are well known in the art, andtherefore will not be described in detail herein. However, it should benoted that the SDR can be programmatically assigned any communicationprotocol that is chosen by a user (e.g., RFID, WiFi, LiFi, Bluetooth,BLE, Nest, ZWave, Zigbee, etc.). The communication protocols are part ofthe device's firmware and reside in memory 208. Notably, thecommunication protocols can be downloaded to the device at any giventime. The initial/default role (being an RFID, WiFi, LiFi, etc. tag) canbe assigned at the deployment thereof. If the user desires to useanother protocol later, the user can remotely change the communicationprotocol of the deployed tag 200. The update of the firmware, in case ofissues, can also be performed remotely.

As shown in FIG. 2, the communication enabled device 204 comprises atleast one antenna 202, 216 for allowing data to be exchanged with theexternal device via a wireless communication technology (e.g., an RFIDtechnology, an NFC technology, a SRC technology, and/or a beacontechnology). The antenna 202, 216 is configured to receive signals fromthe external device and/or transmit signals generated by thecommunication enabled device 204. The antenna 202, 216 can comprise anear-field or far-field antenna. The antennas include, but are notlimited to, a chip antenna or a loop antenna.

The communication enabled device 204 also comprises a communicationdevice (e.g., a transceiver or transmitter) 206. Communication devices(e.g., transceivers or transmitters) are well known in the art, andtherefore will not be described herein. However, it should be understoodthat the communication device 206 generates and transmits signals (e.g.,RF carrier signals) to external devices, as well as receives signals(e.g., RF signals) transmitted from external devices. In this way, thecommunication enabled device 204 facilitates the registration,identification, location and/or tracking of an item (e.g., object 110 or112 of FIG. 1) to which the tag 200 is coupled.

The communication enabled device 204 is configured so that it:communicates (transmits and receives) in accordance with a time slotcommunication scheme; and selectively enables/disables/bypasses thecommunication device (e.g., transceiver) or at least one communicationsoperation based on output of a motion sensor 250. In some scenarios, thecommunication enabled device 204 selects: one or more time slots from aplurality of time slots based on the tag's unique identifier 224 (e.g.,an Electronic Product Code (“EPC”)); and/or determines a Window Of Time(“WOT”) during which the communication device (e.g., transceiver) 206 isto be turned on or at least one communications operation is be enabledsubsequent to when motion is detected by the motion sensor 250. The WOTcan be determined based on environmental conditions (e.g., humidity,temperature, time of day, relative distance to a location device (e.g.,beacon or location tag), etc.) and/or system conditions (e.g., amount oftraffic, interference occurrences, etc.). In this regard, the tag 200can include additional sensors not shown in FIG. 2.

The communication enabled device 204 also facilitates the automatic anddynamic modification of item level information 226 that is being or isto be output from the tag 200 in response to certain trigger events. Thetrigger events can include, but are not limited to, the tag's arrival ata particular facility (e.g., RSF 128 of FIG. 1), the tag's arrival in aparticular country or geographic region, a date occurrence, a timeoccurrence, a price change, and/or the reception of user instructions.

Item level information 226 and a unique identifier (“ID”) 224 for thetag 200 can be stored in memory 208 of the communication enabled device204 and/or communicated to other external devices (e.g., tag reader 120of FIG. 1, beacon 146 of FIG. 1, MCD 130 of FIG. 1, and/or server 124 ofFIG. 1) via communication device (e.g., transceiver) 206 and/orinterface 240 (e.g., an Internet Protocol or cellular networkinterface). For example, the communication enabled device 204 cancommunicate information specifying a timestamp, a unique identifier foran item, item description, item price, a currency symbol and/or locationinformation to an external device. The external device (e.g., server orMCD) can then store the information in a database (e.g., database 126 ofFIG. 1) and/or use the information for various purposes.

The communication enabled device 204 also comprises a controller 210(e.g., a CPU) and in-put/output devices 212. The controller 210 canexecute instructions 222 implementing methods for facilitating inventorycounts and management. In this regard, the controller 210 includes aprocessor (or logic circuitry that responds to instructions) and thememory 208 includes a computer-readable storage medium on which isstored one or more sets of instructions 222 (e.g., software code)configured to implement one or more of the methodologies, procedures, orfunctions described herein. The instructions 222 can also reside,completely or at least partially, within the controller 210 duringexecution thereof by the tag 200. The memory 208 and the controller 210also can constitute machine-readable media. The term “machine-readablemedia,” as used here, refers to a single medium or multiple media (e.g.,a centralized or distributed database, and/or associated caches andservers) that store the one or more sets of instructions 222. The term“machine-readable media,” as used here, also refers to any medium thatis capable of storing, encoding, or carrying a set of instructions 222for execution by the tag 200 and that cause the tag 200 to perform anyone or more of the methodologies of the present disclosure.

The input/output devices can include, but are not limited to, a display(e.g., an E Ink display, an LCD display and/or an active matrixdisplay), a speaker, a keypad, and/or light emitting diodes. The displayis used to present item level information in a textual format and/orgraphical format. Similarly, the speaker may be used to output itemlevel information in an auditory format. The speaker and/or lightemitting diodes may be used to output alerts for drawing a person'sattention to the tag 200 (e.g., when motion thereof has been detected)and/or for notifying the person of a particular pricing status (e.g., onsale status) of the item to which the tag is coupled.

The clock/timer 214 is configured to determine a date, a time, and/or anexpiration of a pre-defined period of time. Technique for determiningthese listed items are well known in the art, and therefore will not bedescribed herein. Any known or to be known technique for determiningthese listed items can be used herein without limitation.

The tag 200 also comprises an optional location module 230. The locationmodule 230 is generally configured to determine the geographic locationof the tag at any given time. For example, in some scenarios, thelocation module 230 employs Global Positioning System (“GPS”) technologyand/or Internet based local time acquisition technology. The presentsolution is not limited to the particulars of this example. Any known orto be known technique for determining a geographic location can be usedherein without limitation including relative positioning within afacility or structure.

The optional coupler 242 is provided to securely or removably couple thetag 200 to an item (e.g., object 110 or 112 of FIG. 1). The coupler 242includes, but is not limited to, a mechanical coupling means (e.g., astrap, clip, clamp, snap) and/or adhesive (e.g., glue or sticker). Thecoupler 242 is optional since the coupling can be achieved via a weldand/or chemical bond.

The tag 200 can also include a power source 236, an optional ElectronicArticle Surveillance (“EAS”) component 244, and/or apassive/active/semi-passive RFID component 246. Each of the listedcomponents 236, 244, 246 is well known in the art, and therefore willnot be described herein. Any known or to be known battery, EAS componentand/or RFID component can be used herein without limitation. The powersource 236 can include, but is not limited to, a rechargeable batteryand/or a capacitor.

As shown in FIG. 2, the tag 200 further comprises an energy harvestingcircuit 232 and a power management circuit 234 for ensuring continuousoperation of the tag 200 without the need to change the rechargeablepower source (e.g., a battery). In some scenarios, the energy harvestingcircuit 232 is configured to harvest energy from one or more sources(e.g., heat, light, vibration, magnetic field, and/or RF energy) and togenerate a relatively low amount of output power from the harvestedenergy. By employing multiple sources for harvesting, the device cancontinue to charge despite the depletion of a source of energy. Energyharvesting circuits are well known in the art, and therefore will not bedescribed herein. Any known or to be known energy harvesting circuit canbe used herein without limitation.

As noted above, the tag 200 may also include a motion sensor 250. Motionsensors are well known in the art, and therefore will not be describedherein. Any known or to be known motion sensor can be used hereinwithout limitation. For example, the motion sensor 250 includes, but isnot limited to, a vibration sensor, an accelerometer, a gyroscope, alinear motion sensor, a Passive Infrared (“PIR”) sensor, a tilt sensor,and/or a rotation sensor.

The motion sensor 250 is communicatively coupled to the controller 210such that it can notify the controller 210 when tag motion is detected.The motion sensor 250 also communicates sensor data to the controller210. The sensor data is processed by the controller 210 to determinewhether or not the motion is of a type for triggering enablement of thecommunication device (e.g., transceiver) 206 or at least onecommunications operation. For example, the sensor data can be comparedto stored motion/gesture data 228 to determine if a match existsthere-between. More specifically, a motion/gesture pattern specified bythe sensor data can be compared to a plurality of motion/gesturepatterns specified by the stored motion/gesture data 228. The pluralityof motion/gesture patterns can include, but are not limited to, a motionpattern for walking, a motion pattern for running, a motion pattern forvehicle transport, a motion pattern for vibration caused by equipment ormachinery in proximity to the tag (e.g., an air conditioner or fan), agesture for requesting assistance, a gesture for obtaining additionalproduct information, and/or a gesture for product purchase. The type ofmovement (e.g., vibration or being carried) is then determined based onwhich stored motion/gesture data matches the sensor data. This featureof the present solution allows the tag 200 to selectively enable thecommunication device (e.g., transceiver) or at least one communicationsoperation only when the tag's location within a facility is actuallybeing changed (e.g., and not when a fan is causing the tag to simplyvibrate).

In some scenarios, the tag 200 can be also configured to enter a sleepstate in which at least the motion sensor triggering of communicationoperations is disabled. This is desirable, for example, in scenarioswhen the tag 200 is being shipped or transported from a distributor to acustomer. In those or other scenarios, the tag 200 can be furtherconfigured to enter the sleep state in response to its continuousdetection of motion for a given period of time. The tag can betransitioned from its sleep state in response to expiration of a definedtime period, the tag's reception of a control signal from an externaldevice, and/or the tag's detection of no motion for a period of time.

The power management circuit 234 is generally configured to control thesupply of power to components of the tag 200. In the event all of thestorage and harvesting resources deplete to a point where the tag 200 isabout to enter a shutdown/brownout state, the power management circuit234 can cause an alert to be sent from the tag 200 to a remote device(e.g., tag reader 120 or server 124 of FIG. 1). In response to thealert, the remote device can inform an associate (e.g., a store employee132 of FIG. 1) so that (s)he can investigate why the tag 200 is notrecharging and/or holding charge.

The power management circuit 234 is also capable of redirecting anenergy source to the tag's 200 electronics based on the energy source'sstatus. For example, if harvested energy is sufficient to run the tag's200 function, the power management circuit 234 confirms that all of thetag's 200 storage sources are fully charged such that the tag's 200electronic components can be run directly from the harvested energy.This ensures that the tag 200 always has stored energy in caseharvesting source(s) disappear or lesser energy is harvested for reasonssuch as drop in RF, light or vibration power levels. If a sudden drop inany of the energy sources is detected, the power management circuit 234can cause an alert condition to be sent from the tag 200 to the remotedevice (e.g., tag reader 120 or server 124 of FIG. 1). At this point, aninvestigation may be required as to what caused this alarm. Accordingly,the remote device can inform the associate (e.g., a store employee 132of FIG. 1) so that (s)he can investigate the issue. It may be that othermerchandise are obscuring the harvesting source or the item is beingstolen.

The present solution is not limited to that shown in FIG. 2. The tag 200can have any architecture provided that it can perform the functions andoperations described herein. For example, all of the components shown inFIG. 2 can comprise a single device (e.g., an Integrated Circuit(“IC”)). Alternatively, some of the components can comprise a first tagelement (e.g., a Commercial Off The Shelf (“COTS”) tag) while theremaining components comprise a second tag element communicativelycoupled to the first tag element. The second tag element can provideauxiliary functions (e.g., motion sensing, etc.) to the first tagelement. The second tag element may also control operational states ofthe first tag element. For example, the second tag element canselectively (a) enable and disable one or more features/operations ofthe first tag element (e.g., transceiver operations), (b) couple ordecouple an antenna to and from the first tag element, (c) by-pass atleast one communications device or operation, and/or (d) cause anoperational state of the first tag element to be changed (e.g., causetransitioning the first tag element between a power save mode andnon-power save mode). In some scenarios, the operational state changecan be achieved by changing the binary value of at least one state bit(e.g., from 0 to 1, or vice versa) for causing certain communicationcontrol operations to be performed by the tag 200. Additionally oralternatively, a switch can be actuated for creating a closed or opencircuit. The present solution is not limited in this regard.

Referring now to FIG. 3, there is provided a detailed block diagram ofan exemplary architecture for a tag reader 300. Tag reader 120 of FIG. 1is the same as or similar to tag reader 200. As such, the discussion oftag reader 200 is sufficient for understanding tag reader 120.

Tag reader 300 may include more or less components than that shown inFIG. 3. However, the components shown are sufficient to disclose anillustrative embodiment implementing the present solution. Some or allof the components of the tag reader 300 can be implemented in hardware,software and/or a combination of hardware and software. The hardwareincludes, but is not limited to, one or more electronic circuits. Theelectronic circuit may comprise passive components (e.g., capacitors andresistors) and active components (e.g., processors) arranged and/orprogrammed to implement the methods disclosed herein.

The hardware architecture of FIG. 3 represents an illustration of arepresentative tag reader 300 configured to facilitate improvedinventory counts and management within an RSF (e.g., RSF 128 of FIG. 1).In this regard, the tag reader 300 comprises an RF enabled device 350for allowing data to be exchanged with an external device (e.g., RFIDtags 112 ₁, . . . , 112 _(N), 118 ₁, . . . , 118 _(X) of FIG. 1) via RFtechnology. The components 304-316 shown in FIG. 3 may be collectivelyreferred to herein as the RF enabled device 350, and may include a powersource 312 (e.g., a battery) or be connected to an external power source(e.g., an AC mains).

The RF enabled device 350 comprises an antenna 302 for allowing data tobe exchanged with the external device via RF technology (e.g., RFIDtechnology or other RF based technology). The external device maycomprise RFID tags 112 ₁, . . . , 112 _(N), 118 ₁, . . . , 118 _(X) ofFIG. 1. In this case, the antenna 302 is configured to transmit RFcarrier signals (e.g., interrogation signals) to the listed externaldevices, and/or transmit data response signals (e.g., authenticationreply signals or an RFID response signal) generated by the RF enableddevice 350. In this regard, the RF enabled device 350 comprises an RFtransceiver 308. RF transceivers are well known in the art, andtherefore will not be described herein. However, it should be understoodthat the RF transceiver 308 receives RF signals including informationfrom the transmitting device, and forwards the same to a logiccontroller 310 for extracting the information therefrom.

The extracted information can be used to determine the presence,location, and/or type of movement of an RFID tag within a facility(e.g., RSF 128 of FIG. 1). Accordingly, the logic controller 310 canstore the extracted information in memory 304, and execute algorithmsusing the extracted information. For example, the logic controller 310can correlate tag reads with beacon reads to determine the location ofthe RFID tags within the facility. The logic controller 310 can alsoperform pattern recognition operations using sensor data received fromRFID tags and comparison operations between recognized patterns andpre-stored patterns. The logic controller 310 can further select a timeslot from a plurality of time slots based on a tag's unique identifier(e.g., an EPC), and communicate information specifying the selected timeslot to the respective RFID tag. The logic controller 310 mayadditionally determine a WOT during which a given RFID tag'scommunication device (e.g., transceiver) or operation(s) is(are) to beturned on when motion is detected thereby, and communicate the same tothe given RFID tag. The WOT can be determined based on environmentalconditions (e.g., temperature, time of day, etc.) and/or systemconditions (e.g., amount of traffic, interference occurrences, etc.).Other operations performed by the logic controller 310 will be apparentfrom the following discussion.

Notably, memory 304 may be a volatile memory and/or a non-volatilememory. For example, the memory 304 can include, but is not limited to,a RAM, a DRAM, an SRAM, a ROM, and a flash memory. The memory 304 mayalso comprise unsecure memory and/or secure memory. The phrase “unsecurememory,” as used herein, refers to memory configured to store data in aplain text form. The phrase “secure memory,” as used herein, refers tomemory configured to store data in an encrypted form and/or memoryhaving or being disposed in a secure or tamper-proof enclosure.

Instructions 322 are stored in memory for execution by the RF enableddevice 350 and that cause the RF enabled device 350 to perform any oneor more of the methodologies of the present disclosure. The instructions322 are generally operative to facilitate determinations as to whetheror not RFID tags are present within a facility, where the RFID tags arelocated within a facility, which RFID tags are in motion at any giventime, and which RFID tags are also in an interrogation zone of an AMinterrogation signal or zone of another sensor (e.g., a camera, aBluetooth beacon or similar near field communication system). Otherfunctions of the RF enabled device 350 will become apparent as thediscussion progresses.

Referring now to FIG. 4, there is provided a detailed block diagram ofan exemplary architecture for a server 400. Server 124 of FIG. 1 is thesame as or substantially similar to server 400. As such, the followingdiscussion of server 400 is sufficient for understanding server 124.

Notably, the server 400 may include more or less components than thoseshown in FIG. 4. However, the components shown are sufficient todisclose an illustrative embodiment implementing the present solution.The hardware architecture of FIG. 4 represents one embodiment of arepresentative server configured to facilitate inventory counts,inventory management, and improved customer experiences. As such, theserver 400 of FIG. 4 implements at least a portion of some methods forEAS, in which an EAS system 100 transmits, over a first window of time,a radio frequency identification (RFID) interrogation signal into anRFID interrogation zone of the EAS system. The system detects aplurality of response signals from a first RFID tag of the EAS systemresponding to the interrogation signal. The EAS system captures, over asecond window of time overlapping at least in part with the first windowof time, image data within a field of view. The field of view and theRFID interrogation zone overlap to form a zone of interest. The EASsystem characterizes movement of a non-tag object during the firstwindow of time based on the image data. The EAS system then determineswhether the first RFID tag is associated with the characterized non-tagobject based on a comparison of the detected plurality of responsesignals and the characterized movement of the non-tag object.

Some or all the components of the server 400 can be implemented ashardware, software and/or a combination of hardware and software. Thehardware includes, but is not limited to, one or more electroniccircuits. The electronic circuits can include, but are not limited to,passive components (e.g., resistors and capacitors) and/or activecomponents (e.g., amplifiers and/or microprocessors). The passive and/oractive components can be adapted to, arranged to, and/or programmed toperform one or more of the methodologies, procedures, or functionsdescribed herein.

As shown in FIG. 4, the server 400 comprises a user interface 402, a CPU406, a system bus 410, a memory 412 connected to and accessible by otherportions of server 400 through system bus 410, and hardware entities 414connected to system bus 410. The user interface can include inputdevices (e.g., a keypad 450) and output devices (e.g., speaker 452, adisplay 454, and/or light emitting diodes 456), which facilitateuser-software interactions for controlling operations of the server 400.

At least some of the hardware entities 414 perform actions involvingaccess to and use of memory 412, which can be a RAM, a disk driver,and/or a Compact Disc Read Only Memory (“CD-ROM”). Hardware entities 414can include a disk drive unit 416 comprising a computer-readable storagemedium 418 on which is stored one or more sets of instructions 420(e.g., software code) configured to implement one or more of themethodologies, procedures, or functions described herein. Theinstructions 420 can also reside, completely or at least partially,within the memory 412 and/or within the CPU 406 during execution thereofby the server 400. The memory 412 and the CPU 406 also can constitutemachine-readable media. The term “machine-readable media,” as used here,refers to a single medium or multiple media (e.g., a centralized ordistributed database, and/or associated caches and servers) that storethe one or more sets of instructions 420. The term “machine-readablemedia,” as used here, also refers to any medium that is capable ofstoring, encoding, or carrying a set of instructions 420 for executionby the server 400 and that cause the server 400 to perform any one ormore of the methodologies of the present disclosure.

In some scenarios, the hardware entities 414 include an electroniccircuit (e.g., a processor) programmed for facilitating the provision ofa three-dimensional map showing locations of RFID tags within a facilityand/or changes to said locations in near real-time. In this regard, itshould be understood that the electronic circuit can access and run asoftware application 422 installed on the server 400. The softwareapplication 422 is generally operative to facilitate: the determinationof RFID tag locations within a facility; the direction of travel of RFIDtags in motion; and the mapping of the RFID tag locations and movementsin a virtual three-dimensional space.

In those or other scenarios, the hardware entities 414 include anelectronic circuit (e.g., a processor) programmed for facilitating iteminventorying, merchandise sale, and/or customer satisfaction with ashopping experience. In this regard, the electronic circuit can accessand run an inventorying software application 422 and an MCD displaysoftware application 422 installed on the server 400. The softwareapplications 422 are collectively generally operative to: obtain itemlevel information and/or other information from MCDs and RFID tags;program item level information, accessory information, related productinformation and/or discount information onto RFID tags and/or MCDs;convert the language, pricing and/or currency symbol of item levelinformation, accessory information, related product information and/ordiscount information; facilitate registration of RFID tags and MCDs withan enterprise system; and/or determine when MCD display update actionsneed to be taken based on RFID tag information. Other functions of thesoftware applications 422 will become apparent as the discussionprogresses. Such other functions can relate to tag reader control and/ortag control.

Referring to FIG. 5, FIG. 6, and FIG. 8, in operation, system 100 mayperform a method 500 of electronic article surveillance, by such as viaexecution of application component 815 by processor 805 and/or memory810—wherein application component 815, processor 805, and/or memory 810are components of computing device 800. Computing device 800 can be oneor more of tag 200, tag reader 300, and server 400.

An EAS system can transmit, over a first window of time, an RFIDinterrogation signal into an RFID interrogation zone of the EASsystem—Block 510. In a continuing example, EAS system 600 (for examplesystem 100) includes RFID tag reader 300 (for example tag reader 120)that transmits an RFID interrogation signal repeatedly over one secondinto interrogation zone 399 in facility 610 (for example retail storefacility 128) covering substantially the front one third of the facility610 including entry/exit 612. This positions RFID tag reader 300 suchthat any operative tag of the system present in the interrogation zone399 during transmission of the interrogation signal will respond per thesystem 600 protocol.

In a further example, referring to FIG. 8, computer device 800,processor 805, memory 810, application component 815, and/ortransmitting component 820 may be configured to or may comprise meansfor transmitting, over a first window of time, an RFID interrogationsignal into an RFID interrogation zone of the EAS system.

The EAS system can detect a plurality of response signals from a firstRFID tag of the EAS system responding to the interrogation signal—Block520. In the continuing example, any tag 200 (such as tag 200 a) attachedto a retail store product that is leaving the retail facility 610 isdetected through the RFID interrogation zone—but so will tag 200 b(which is attached to a retail store product on display and not leavingthe retail facility 610). The RFID response signal from tag 200 a, as itis leaving the store, varies in signal strength; while the strength ofthe RFID response signal from tag 200 b stays fairly constant. In someexamples, the RFID response itself contains a received signal strengthindicator (RSSI) information element describing the strength of the RFIDinterrogation signal as that signal is received from the RFID tag reader300. In some examples, the detecting further comprises detecting thatthe tag is not authorized to be in the RFID interrogation zone. Forexample, only tags that are not authorized to be in the RFIDinterrogation zone are considered. Response signals from tags that areauthorized, for example by completion of a purchase transaction of thearticle to which the tag is attached, will be ignored after beingdetected.

In the further example of FIG. 8, computer device 800, processor 805,memory 810, application component 815, and/or indicating component 825may be configured to or may comprise means for detecting a plurality ofresponse signals from a first RFID tag of the EAS system responding tothe interrogation signal.

Over a second window of time overlapping at least in part with the firstwindow of time, image data is captured within a field of view, the fieldof view and the RFID interrogation zone overlapping to form a zone ofinterest—Block 530. In the continuing example, camera 650 (for examplecamera 148) captures video in field of view 699. In other examples, acamera 650 captures a series of still images over the second window oftime, e.g., as tag 200 a is moving through the entry/exit 612. RFIDinterrogation zone 399 and field of view 699 overlap across entry/exit612 to form zone of interest 680. In some examples, the capturing is inresponse to the detecting.

In the further example of FIG. 8, computer device 800, processor 805,memory 810, application component 815, and/or capturing component 830may be configured to or may comprise means for capturing, over a secondwindow of time overlapping at least in part with the first window oftime, image data within a field of view, the field of view and the RFIDinterrogation zone overlapping to form a zone of interest.

The EAS system can characterize movement of a non-tag object during thefirst window of time based on the image data—Block 540. In thecontinuing example, the system 600 detects and derives one or moreindicators from the captured video, including that a person is movingthrough the portal, and the speed of a person is moving through theportal. In other examples, the system 600 (e.g., using server 400 toanalyze the video data) determines the direction of travel of a cart ofthe retail facility 610.

In the further example of FIG. 8, computer device 800, processor 805,memory 810, application component 815, and/or characterizing component835 may be configured to or may comprise means for characterizingmovement of a non-tag object during the first window of time based onthe image data.

The EAS system can determine whether the first RFID tag is associatedwith the characterized non-tag object based on a comparison of thedetected plurality of response signals and the characterized movement ofthe non-tag object—Block 550. In the continuing example, the server 400analyzes the captured video data to identify a person moving through thezone of interest 680 and compares to the signal strength data collectedby the tag reader 300 via the RFID signal response that occurredconcurrently with the person's passage through the portal. Throughempirical data, the movement characteristics (e.g., speed, direction,progression over time) of the object (e.g., a person, a cart) capturedin the video data are compared by the server 400 to the variation insignal characteristics of the response (e.g., change in amplitude,change in phase, change in RSSI at the tag 200) to determine whether thefirst RFID tag 200 a is associated with the characterized non-tagobject. In some examples, whether the first RFID tag 200 a is associatedwith the characterized non-tag object includes determining a similaritygreater then a threshold similarity between the detected plurality ofresponse signals and the characterized movement of the non-tag object.

In the further example of FIG. 8, computer device 800, processor 805,memory 810, application component 815, and/or characterizing component840 may be configured to or may comprise means for determining whetherthe first RFID tag is associated with the characterized non-tag objectbased on a comparison of the detected plurality of response signals andthe characterized movement of the non-tag object.

Referring to FIG. 6, FIG. 7, and FIG. 8, in some examples of thetechnology disclosed herein, the EAS system alarms in response todetermining that the first RFID tag is associated with the characterizednon-tag object based on a comparison of the detected plurality ofresponse signals and the characterized movement of the non-tagobject—Block 660. In such examples, Block 510—Block 550 are performed asdescribed above. In the continuing example, the RFID tag response andcomparison to the walking speed of the person observed passing throughthe entry/exit 612 by the camera 650 indicates that an article may bepassing thought the exit/entry 612 without being purchased, hencecausing the system 600 to alarm.

In the further example of FIG. 8, computer device 800, processor 805,memory 810, application component 815, and/or characterizing component840 may be configured to or may comprise means for alarming in responseto determining that the first RFID tag is associated with thecharacterized non-tag object based on a comparison of the detectedplurality of response signals and the characterized movement of thenon-tag object.

Some examples of the technology disclosed herein include an electronicarticle surveillance (EAS) system using RFID elements to provide EASfunctions. In such examples, the EAS system includes an EAS portal, andone or more video cameras capturing video data in the vicinity of theEAS portal. An EAS tag has a tag housing, and an RFID element isdisposed in the tag housing.

The EAS tag can have a passive RFID element disposed in the tag housing.The passive RFID element is responsive to an RFID interrogation fieldapplied at the EAS portal to generate an encoded RF signal that isinterpreted as an EAS response when an unauthorized RFID tag is movingthrough the portal. Such examples further include one or more videocameras positioned at various angles capture image data of people andobjects moving though the EAS portal. Video images of personsapproaching the exit are collected by the cameras. A processorassociated with the EAS portal has a software application runningthereon which analyzes the video image data to determine if a person ismoving thought the portal.

In some examples of the technology disclosed herein, the video systemcan detect and derive any number of relevant indicators from thecaptured video, such as whether the detected image includes a person,the number of persons in the image, the speed a person is moving throughthe portal, other objects associated with the one or more persons, suchas shopping carts, carried items, etc., and the nature of the objects.In one embodiment, the process detects a person's walking speed. Thecaptured video data is analyzed and compared to data collected by theRFID signal response that occurred concurrently with the person'spassage through the portal . . . . The velocity at which an RFID tag ispassing through the portal can be calculated by analyzing thecharacteristics of the response signal, such as the rate of change ofthe signal strength.

In one scenario, which an RFID tag response indicates that an articlemay be passing thought the portal without being purchased, an Alarm flagcan be set. In response to the Alarm flag, the rate of speed at whichthe tag is moving through the portal can be estimated by analyzing theRFID tag response. Also in response to the Alarm flag, video data iscaptured and analyzed to identify a image data of a person who may betransporting the tag, and also to determine various factors, such as theperson's walk rate. In one scenario, the person's walk rate is comparedwith the estimated rate of speed of the RFID tag. If predeterminedthresholds are met, the EAS portal can sound an alarm.

The previous description is provided to enable any person skilled in theart to practice the various aspects described herein. Variousmodifications to these aspects will be readily apparent to those skilledin the art, and the generic principles defined herein may be applied toother aspects. Thus, the claims are not intended to be limited to theaspects shown herein, but is to be accorded the full scope consistentwith the language claims, wherein reference to an element in thesingular is not intended to mean “one and only one” unless specificallyso stated, but rather “one or more.” The word “exemplary” is used hereinto mean “serving as an example, instance, or illustration.” Any aspectdescribed herein as “exemplary” is not necessarily to be construed aspreferred or advantageous over other aspects. Unless specifically statedotherwise, the term “some” refers to one or more. Combinations such as“at least one of A, B, or C,” “one or more of A, B, or C,” “at least oneof A, B, and C,” “one or more of A, B, and C,” and “A, B, C, or anycombination thereof” include any combination of A, B, and/or C, and mayinclude multiples of A, multiples of B, or multiples of C. Specifically,combinations such as “at least one of A, B, or C,” “one or more of A, B,or C,” “at least one of A, B, and C,” “one or more of A, B, and C,” and“A, B, C, or any combination thereof” may be A only, B only, C only, Aand B, A and C, B and C, or A and B and C, where any such combinationsmay contain one or more member or members of A, B, or C. All structuraland functional equivalents to the elements of the various aspectsdescribed throughout this disclosure that are known or later come to beknown to those of ordinary skill in the art are expressly incorporatedherein by reference and are intended to be encompassed by the claims.

Moreover, nothing disclosed herein is intended to be dedicated to thepublic regardless of whether such disclosure is explicitly recited inthe claims. The words “module,” “mechanism,” “element,” “device,” andthe like may not be a substitute for the word “means.” As such, no claimelement is to be construed as a means plus function unless the elementis expressly recited using the phrase “means for.”

What is claimed is:
 1. A method of electronic article surveillance(EAS), comprising: transmitting, over a first window of time, a radiofrequency identification (RFID) interrogation signal into an RFIDinterrogation zone of an EAS system, detecting a plurality of responsesignals from a first RFID tag of the EAS system responding to theinterrogation signal; capturing, over a second window of timeoverlapping at least in part with the first window of time, image datawithin a field of view, the field of view and the RFID interrogationzone overlapping to form a zone of interest; characterizing movement ofa non-tag object during the first window of time based on the imagedata; and determining whether the first RFID tag is associated with thecharacterized non-tag object based on a comparison of the detectedplurality of response signals and the characterized movement of thenon-tag object.
 2. The method of claim 1, wherein the capturing is inresponse to the detecting.
 3. The method of claim 2, wherein thedetecting further comprises detecting that the tag is not authorized tobe in the RFID interrogation zone.
 4. The method of claim 3, furthercomprising, alarming in response to determining that the first RFID tagis associated with the characterized non-tag object based on acomparison of the detected plurality of response signals and thecharacterized movement of the non-tag object.
 5. The method of claim 1,wherein characterizing comprises estimating one or more of a speed ofthe non-tag object and a direction of travel of the non-tag object. 6.The method of claim 1, wherein determining whether the first RFID tag isassociated with the characterized non-tag object comprises determining asimilarity greater then a threshold similarity between the detectedplurality of response signals and the characterized movement of thenon-tag object.
 7. A electronic article surveillance (EAS) system,comprising: a radio frequency identification (RFID) tag reader operativeto: transmit, over a first window of time, a radio frequencyidentification (RFID) interrogation signal into an RFID interrogationzone of an EAS system, and detect a plurality of response signals from afirst RFID tag responding to the interrogation signal; a cameraoperative to capture, over a second window of time overlapping at leastin part with the first window of time, image data within a field ofview, the field of view and the RFID interrogation zone overlapping toform a zone of interest; and at least one processor: in communicationwith the tag reader and the camera; and operative to: characterizemovement of a non-tag object during the first window of time based onthe image data; and determine whether the first RFID tag is associatedwith the characterized non-tag object based on a comparison of thedetected plurality of response signals and the characterized movement ofthe non-tag object.
 8. The system of claim 7, wherein the capturing isin response to the detecting.
 9. The system of claim 8, wherein thedetecting further comprises detecting that the tag is not authorized tobe in the RFID interrogation zone.
 10. The system of claim 9, whereinthe processor is further operative to alarm in response to determiningthat the first RFID tag is associated with the characterized non-tagobject based on a comparison of the detected plurality of responsesignals and the characterized movement of the non-tag object.
 11. Thesystem of claim 7, wherein characterizing comprises estimating one ormore of a speed of the non-tag object and a direction of travel of thenon-tag object.
 12. The system of claim 7, wherein determining whetherthe first RFID tag is associated with the characterized non-tag objectcomprises determining a similarity greater then a threshold similaritybetween the detected plurality of response signals and the characterizedmovement of the non-tag object.
 13. An apparatus for electronic articlesurveillance (EAS), comprising: means for transmitting, over a firstwindow of time, a radio frequency identification (RFID) interrogationsignal into an RFID interrogation zone of an EAS system, means fordetecting a plurality of response signals from a first RFID tag of theEAS system responding to the interrogation signal; means for capturing,over a second window of time overlapping at least in part with the firstwindow of time, image data within a field of view, the field of view andthe RFID interrogation zone overlapping to form a zone of interest;means for characterizing movement of a non-tag object during the firstwindow of time based on the image data; and means for determiningwhether the first RFID tag is associated with the characterized non-tagobject based on a comparison of the detected plurality of responsesignals and the characterized movement of the non-tag object.
 14. Theapparatus of claim 13, wherein the capturing is in response to thedetecting.
 15. The apparatus of claim 14, wherein the means fordetecting further comprises means for detecting that the tag is notauthorized to be in the RFID interrogation zone.
 16. The apparatus ofclaim 15, further comprising, means for alarming in response todetermining that the first RFID tag is associated with the characterizednon-tag object based on a comparison of the detected plurality ofresponse signals and the characterized movement of the non-tag object.17. The apparatus of claim 13, wherein characterizing comprisesestimating one or more of a speed of the non-tag object and a directionof travel of the non-tag object.
 18. The apparatus of claim 13, whereindetermining whether the first RFID tag is associated with thecharacterized non-tag object comprises determining a similarity greaterthen a threshold similarity between the detected plurality of responsesignals and the characterized movement of the non-tag object.